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ABSTRACT 



A digital multimedia newsroom production system allows 
users of the system to create, browse and catalog multimedia 
assets. The system includes a journalist workstation for 
accessing multimedia assets stored in a multimedia archive 
to create a multimedia storyboard of a news story to be 
broadcast from the system. The storyboard includes frames 
of video retrieved from one or more sources, and text 
retrieved from one or more sotuces or generated by a user of 
the journalist workstation. In one embodiment of the 
invention, mu ltimedia data captured by th e newsroom pro- 
duction system undergoes a dual digitization process to 
create a hi gh resolut ion j/.ersion of the media data and a low 
resolutiog ^ersion of the mediT^dat a. The low resolution 
version of the media data can be efficiently stored in the 
system and may be transmitted over a low-bandwidth net- 
work to the journalist workstation for use in the creation of 
a storyboard. 

8 Claims, 3 Drawing Sheets 
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DIGITAL MULTIMEDIA EDITING AND DATA provide some integration of the text production process with 

MANAGEMENT SYSTEM the audio/video production process. However, only limited 

integration of the text and audioMdeo data has been 

BACKGROUND OF THE INVENTION achieved, thereby providing only Hmited multimedia capa- 

5 bihty. 

1. Field of the Invention j^o^ p^or art systems, when a journalist in a news- 
The present invention relates generally to an audio/video room is preparing a story and wishes to incorporate video 

data management and editing system, and more particularly, from a previous broadcast that is contained in a video tape 

to a method and apparatus for editing and managing multi- archive, the journalist must request that the tape be retrieved 

media data in a multimedia production environment, manually, and must then review the tape in an edit bay or a 

2. Discussion of the Related Art ^^^^ location. Although the journalist does not typically 

f J • u J . L prepare the final edited audio/video tape for broadcast, the 

The process for producing broadcast news programs has ^-^^ ^^^^^^ 

undergone several changes over the last few decades. events, text or graphics received over news wire services, 

Changes m available technology, as weU as increased com- and archived text to perform preliminary editing of this 

peution brought about by the expansion of cable outlets and 15 material in order to prepare an integrated story for broadcast, 

other news sources, have forced news broadcasters to use Jn present day systems, the capability to perform the above- 

theu- resources more effectively while striving to differen- identified functions is not available to the journalist in the 

tiate their programming. newsroom system, but as discussed above, must be per- 

In a typical news production operation, there are four formed remote to the newsroom, for example, in an edit bay. 

major processes that must occur to produce a news program. SUMMARY OF THE INVENTION 

These processes are identified in FIG. 1. and include video i uj-.i^t . . 

production 10, graphics production 12, text production 14 In one embodiment of the present mvention, a digital 

and on-air operations 16. The results of these processes are newsroom production system ,s provided that 

rarely effectively combined untfl the actual broadcast of the '""^ T"" '° f ^^Jf' '=^'^°g 

news program. The video production process 10 includes the " '".""^^'fif ^t^; ^ Preferred embodiment of the system, 

generation and editing of tape-based video for broadcast " '"^"^^ workstaUon is provided that aUows a user of the 

using videotape retrieved from a videotape archive or pro- ^ ^^^^ muUin.ed,a assets stored in a multi- 

duced from one or more sources (i.e. cameras, either studio "^'"^f " ^'^^ !^.^ J™"^'^1 workstation can 

or field recorded). Hie text production process includes the " f'^y^"'' \ multunedia product for broadcast, 

scripting and editing of text gathered from several sources J^^ ^toryboard may mclude frames of low resolution video 

including a text archive. Similar to the tape production ^"^""^ fron> several sources 

process and the text production process, the graphics pro- T f '"^ "'"'"^ 

duction process 12 includes the generation and editing of '^'"^^ ^'^^ """^^^^^ S'^P^f^' 

graphics data gathered from several sources. P"^'"'*"' multmiedia data. 

m order to produce the final news product for broadcast, ^l"J-fZ"^ °^ ^'""'"l, ^ 

tK^ 1* ffu -J J *• u . - multimedia data captured by the newsroom production svs- 

the results of the video production process 10, the graphics t^rr, « ^ i ^- * i 

«r^^„^f; ^ n^»u.r ^ tem undergoes a dual digitization process to create a high- 

h nmnTT^ , f H H " resolution version of the media data and a low resolution 

must be properly mtegrated dunng the on-air operations to ^^rsion of the media data. The low resolution media data can 

produce the finished product. u ■ *i * j j . . , , 

. ^ 40 be etticiently stored and may be transmitted over a low- 

Existing news broadcast systems provide the capability bandwidth network to the journafist workstation for use by 
for the mtegration of the video production process, the a journalist in creating a storyboard. Meta-data as sociated ^-mA^ qIsJL 
graphics production process and the on-air operations to with the low resolution media data aiid thehigh resolution ^ 
provide complete management of audio and video elements media datTHavrcommon-identifiers-sTthifl ^i^^ 
of the news program firom acquisition, through editing. 45 final broadcast ver sion of the multimedia datFcan view and 
distribution and on-au" play. An integrated process in accor- edit a h T^ resolution version of the storygoaTd created by 
dance with one such system is shown in FIG. 2. As shown thelml malist using the low resolution data-j Tlt^refened 
m FIG. 2. a disk-based video production process is inte- embodiment of the present invention, the translation of the 
grated with a media production process 32 and on air low resolution version of the video storyboard to the high 
operations 34. The use of disk-based digital audio/video 50 resolution version is transparent to a user of the system 
storage systems digital networks, and digital non-linear another embodimem of the present invention a work- 
editing systems has allowed for successful mtegration of the station graphics user interface includes muhipie display 
video production, grapk^ production and on-au ^^^^ows for displaying and manipulating a storyboard. In a 
Several products are available from Avid Technology, Inc., p^fe^red embodiment the storyboard includes: a viewing 
Tewl^ury, Mass., for providing the mtegration shown in 55 window for displaying real-time video; a clipnotes window 

for displaying text entered by a user of the system to 

The newsroom text production and management system describe a video clip in the viewing window; a storyboard 
24 of FIG. 2 is the same text production and management window for displaying a number of video clips and subclips 
system shown in FIG. 1. Although newsroom computer selected by the user of the workstation; a storynotes window 
systems have been in use for over 15 years, these computer 60 for displaying notes generated by the user describing the 
systems are predominately text based, and have limited story to be depicted by the video chps in the storyboard 
integration capabilities with tape-based or disk-based audio/ window; and a script window for displaying a broadcast 
video production systems. Newsroom computer systems script generated by the user corresponding to the story 
have typically grown out of systems which were developed depicted on the storyboard. In the preferred embodiment, the 
to receive news agency copy and provide simple word 65 viewing window includes machine controls and edit buttons 
processing and communications facilities. In more recent for controlling and editing the video displayed in the view- 
years, add-ons of various kinds have been developed which ing window. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a belter understanding of the present invention, ref- 
erence is made to the accompanying drawings which are 
incorporated herein by reference and in which: ^ 

FIG. 1 is a block diagram of traditional processes that 
occur in a typical television news operation; 

FIG. 2 is a block diagram of the processes that occur in 
a typical television news operation having audio/video pro- 
duction capabilities integrated with on-air operations: lo 

FIG. 3 is a block diagram of a digital multi-media 
newsroom production system in accordance with one 
embodiment of the present invention; 

FIG. 4 is a block diagram of a user interface of a digital 
multi-media newsroom production system in accordance 
with one embodiment of the present invention; and 

FIG. 5 is a diagram of a multi -media file structure in 
accordance with one embodiment of the present invention. 

DETAILED DESCRIPTION 20 

FIG. 3 shows a digital multimedia newsroom production 
system 90 in accordance with one embodiment of the 
present invention. The system provides a completely digital, 
networked, multimedia news production and display system. 25 
The system 90 shown in FIG, 3 includes three major 
systems, a core newsroom system 100, a multi-media 
archive 200, and a video production system 300. 

The components of the core newsroom system and the 
multimedia archive are interconnected using a first digital 30 
network 400. The components of the video production 
system are interconnected with a second digital network 
410. An adaptor box 420, connected to the digital networks, 
provides communication between the networks. In a pre- 
ferred embodiment of the present invention, the first digital 35 
network is implemented using an Ethernet system having a 
data rate equal to, or greater than, 100 Mb/s and the second 
digital network is implemented using an Ethernet system 
having a data rate equal to, or greater than, 10 Mb/s, The 
adaptor box 420 may be implemented using one of a niimber 40 
of commercially available products such as a FastNet 10 
available from Cabletron Systems, Inc, Rochester, N.H. In 
an alternate embodiment of the present invention, the first 
and second networks may be implemented using one 100 
Mb/s network. In this alternate embodiment, the adaptor box 45 
420 is not used. . 

Each of the major components of the system are described 
in greater detail below. 
Video Production System 

The video production system 300 provides audio/video 50 
capture, media data editing, and management and control of 
high quality multimedia data suitable for broadcast. Multi- 
media data is defined as any form of information that can be 
represented in a digital form. The video production system 
includes a digital playback system 310. a video editor 320. 55 
a media recorder 330 connected to an MPEG encoder 340, 
a media server 350 including an asset manager 360, a high 
bandwidth data network 364, and a graphics workstation 
370. 

The media server is a large scale computer that stores and 60 
delivers high quality audio and motion JPEG video 
(MJPEG), suitable for broadcast, in conjunction with the 
other devices of the video production system. The media 
server can also function as an archive system for multimedia 
data produced in the video production system. In a preferred 65 
embodiment of the present invention, additional near-line 
storage and off-line storage is provided on a digital data 



4 

storage medium, such as tape or optical disks, to relieve the 
media server of archive responsibilities to provide additional 
on-line storage capabilities within the media server. 

An asset manager 360 is an integral part of the media 
server and is implemented as software in the media server. 
The asset manager stores information and is the tool used to 
manage the data stored in the near-line storage and the 
off-line storage. The material stored in the media archive can 
be automatically moved to on-line status on the media server 
by the asset manager. The asset manager contains search 
support data for locating media objects stored in the media 
server, in the near-line storage system and in the off-line 
storage system. Tlie asset manager also contains composi- 
tion information that can be used to capture, edit, and play 
back the media objects stored in the media server. As 
described below in greater detail, the media server also 
provides translation of low resolution media data 
compositions, generated within the core newsroom system, 
to high resolution media data compositions for editing and 
playback within the video production system. In a preferred 
embodiment, the media server is implemented using an Avid 
MediaServer™ available from Avid Technology, Inc., 
Tewksbury, Mass, 

The media recorder 330 is a disk-based digital recording 
workstation which is used to capture audio/video data and 
provide digitization and compression of the audio/video 
data. The media recorder digitizes, compresses and records 
audio/video material and transmits the digitized compressed 
data to the media server over the high speed network for 
storage on the media server. 

In a preferred embodiment of the present invention, the 
media recorder uses an MJPEG encoding scheme to gener- 
ate high quahty, high resolution, compressed digital data 
suitable for broadcast. In the preferred embodiment, an 
MPEG encoder 340 is coupled to the media recorder 330 to 
also provide MPEG compression capability. As described in 
greater detail below, the addition of the MPEG encoder lo 
the media recorder provides the system with a dual- 
digitizing capability for media data recorded by the media 
recorder. The MPEG encoder provides greater compression 
of the data than the media recorder, thereby allowing the 
data to be eflBciently transmitted over the Ethernet network 
400 to be played on the journalist workstations 110. As 
shown in FIG. 3 the MPEG encoder has a direct connection 
to the digital network 400 to provide MPEG encoded media 
data to the multimedia archive. 

In a preferred embodiment, the media recorder is imple- 
mented using an Avid Media Recorder'^^'^ available from 
Avid Technology Inc., Tewksbury , Mass. 

The video editor 320 is a full- feature, digital, non-linear 
video editing workstation specifically tailored to provide 
functions for news editing. I'he video editor provides editing 
of high resolution broadcast quality images provided by the 
media server 350. In a preferred embodiment, the video 
editor is implemented using a an Avid NewsCutter''" or an 
Avid Media Composer®, both of which are available from 
Avid Technology Inc., Tewksbury, Mass. 

The digital playback system 310 is a digital, disk-based 
playback system that manages the broadcast to air of mul- 
timedia data produced and stored within the video produc- 
tion system. The digital playback system plays materials 
stored either locally or on the media server 350 in accor- 
dance with play lists generated firom a program lineup 
created on one of the journalist workstations within the core 
newsroom system, or on a workstation directly coupled to 
the video production system (not shown). In a preferred 
embodiment of the present invention, the digital playback 
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system is implemented using an Avid AirPlay® available 
from Avid Technology, Inc., Tewksbury, Mass. 

The high bandwidth network 364 provides high speed 
communication between the components of the video pro- 
duction system. In a preferred embodiment of the present 
invention, the high bandwidth network is implemented using 
an ATM network as described in co-pending U.S. patent 
application Ser. No. 08/249,849, titled An Apparatus and 
Computer Implemented Process For Providing Real-Time 
Multimedia Data Transport in a Distributed Computing 
System, which is incorporated herein by reference. The high 
bandwidth network 360 supports real time playback of 
broadcast quality MJPEG video and multi-track audio over 
fiber optic networks. 

The graphics workstation 370 is used for generating and 
editing graphics material for broadcast from and storage in 
the video production system. In a preferred embodiment, the 
graphics workstation 370 is implemented using a Matador 
Workstation available from Avid Technology, Inc., 
Tewksbury, Mass. 
TTae Core Newsroom System 

The core newsroom system 100 consists primarily of a 
number of journalist workstations HO and a pair of news 
servers 120. FIG. 3 shows a newsroom system having three 
journalist workstations 110. In embodiments of the 
invention, the number of workstations actually used may be 
much greater than three, and the actual number of journalist 
workstations that may be used in the system is based on 
several factors including the amount of network activity 
generated by each user of the workstations and by the 
amount of delay each user will tolerate in accessing the 
system. 

In a preferred embodiment of the present invention, each 
of the journalist workstations 110 is implemented using an 
MFC III compliant workstation. 

The journalist workstation provides access to multimedia 
data from a variety of sources and includes the tools (i.e. 
software) necessary to create a multimedia storyboard of a 
news story for broadcast. The multimedia data available to 
the journalist includes the low resolution MPEG video data 
captured by the media recorder. In one embodiment of the 
present invention each of the journalist workstations 
includes a video port for receiving video from, for example, 
a video tape recorder. Each of the journalist workstations 
also includes a serial port for controlhng the video tape 
recorder. The graphics user interface of the journalist work- 
station and the functions available to a user of the journalist 
workstation are described in greater detail below. 

The news server 120 provides the management and stor- 
age of multimedia data in the newsroom environment. The 
news servers are configured as distributed processors with 
mirrored data bases to provide maximum reliability and 
performance. Other centralized functions, such as commu- 
nications functions, are managed by the news servers 120. In 
a preferred embodiment, the news servers are implemented 
using an Avid NewsServer available from Avid Technology, 
Inc., Tewksbury, Mass. The news servers have external 
connections 122 for providing access to news wire services 
and to allow remote access to the news server from users 
external to the core news room system. 

The core newsroom system 100 may also include one or 
more terminal servers 140 to provide connection to the 
digital network 400 for user terminals 130. The user termi- 
nals may be one of several different terminals used in prior 
art systems primarily for text processing and communica- 
tions functions. A device controller 150, or a number of 
device controllers 150, may also be coupled to the digital 



network 400 to provide control of several muUimedia 
devices, such as teleprompters, from the journalist worksta- 
tions. 

Muhimedia Archive 

The multimedia archive (MMA) consists of a library 
server 210 and one or more object servers 220. The library 
server holds catalog and search support meta da ta for 
locating objects stored in the multimedia archive. 

The object server provides the primary storage media for 
browsing and archival of material generated during news 
gathering and production processes. The object server works 
in conjunction with the library server to facilitate distribu- 
tion of multimedia material to the journalist workstations. 
The objects stored in the multimedia archive can be low 
resolution versions of video audio, graphics, and text. The 
MMA can be ;ised to store finished stories, audio, video and 
other content for reuse in creating new stories. In a preferred 
embodiment, the muhimedia archive 200 is implemented 
using the IBM Digital library 5765-258. 

The operation of the digital multimedia newsroom pro- 
duction system 90 Shown in FIG. 3 is described below. The 
operation of the system can be described as a collection of 
distinct function specific workloads characterized at a high 
level as asset creation, asset use, asset storage, and asset 
administration. The system provides the capability for the 
following functions: 

News wire text capture, storage, and catalog; 
News story text creation, storage, and catalog; 
High resolution video capture, edit, playout, storage and 
catalog; 

Video production system low resolution media data edit- 
ing; 

Real-time dual resolution digitization, storage and cata- 
log; 

Low resolution video browsing and editing; 
High-resolution playout and editing of low resolution 
composition; 

Each of the functions described above, along with user 
interfaces for accomplishing these functions, are described 
40 below in greater detail. 

News Wire Text Capture, Storage and Catalog 

The news servers 120 provide capability for capture and 
storage of news wire text data through the external interfaces 
122. News wire text stories are captured by the news servers 
and cataloged in a database of the news servers. A user of 
one of the journalist workstations may access the news 
scrvers'databases as a system librarian to search, browse and 
retrieve the wire service data stored in the databases of the 
news servers. It is not generally necessary to store all text 
stories captured by the news servers in the multimedia 
archive 200. A system administrator may access the news 
servers through one of the journalist workstations, browse 
the catalog of data received from the news wires, determine 
what stories are appropriate for storage in the multimedia 
archive and command the news servers to transfer selected 
data to the multimedia archive for storage. 
News Story, Create, Storage, and Catalog 

A user of the journalist workstation can access text 
through the news servers 120 and can create text and scripts 
from scratch or can use existing text and scripts stored in the 
news servers or in the multi-media archive in the creation of 
text and scripts. The user can search, browse and retrieve 
text data stored in the news servers 120 and the multi-media 
archive 200. The user can perform this searching and 
browsing using complex, full-text search techniques, 
thereby allowing efficient research by focusing the searching 
to retrieve data specifically relevant to the user's needs. 



10 



15 



20 



25 



30 



35 



45 



50 



55 



60 



65 



5,852,435 

7 8 

High Resolution Video Capture, Edit, Playout, Storage and tions with low resolution video to allow browsing and 

Catalog editing of the low resolution video to create storyboards 

High resolution media data utilized by the video produc- which may ultimately be used by an editor using the video 

lion system is captured in the system by the media recorder editor 320 to create broadcast quality media data. The low 

330. The high resolution media data is captured in the media 5 resolution editing feature allows the journalist to become 

recorder, digitized and compressed using a broadcast quality ,^0^ involved in the finished media product and to incor- 

corapression technique such as MJPEG. The media data pQ^^te archived media data into storyboards without the 

captured by the media recorder is transferred m compressed ^^^^ ^^^^^j ,^^,^^^^1 ^^^^ ^ operation of a 

form to the media server and is registered and stored in the ^ -^^ ^ ^ ^ ^ ^^^^^^ ^ ^^^^ 

media server by the asset manager 360. As discussed ftirther a journalist, using the journalist workstation, can search 

below, in a preferred embodiment of the present mvention, ,u j * * • j ♦u- *u ru -im e 

a low resolution version of the media data is simultaneously the data contamed withm the library server 210 of the 

created with the high resolution media data. multmiedia archive 200 for low resolution video data, audio 

Tlie high resolution media data can be browsed and edited ^ata and text related to a story that the joumahst is com- 

using the video editor 320 and can be broadcast to air using P^^^^S ^he journahst workstation. In response to key 

the digital playback system 310. search words provided by the journalist, the multimedia 

Video Production System Low Resolution Media Data Edit- archive provides a list of material contained therein related 

ing to the key words. The journalist can then select media data 

As discussed above, low resolution video is used by the for browsing, or editing on the journalist workstation from 

journalist workstations to provide limited editing capability. the list of material. 

A user of the video production system, for example a user of 20 The graphics user interface for storyboard creation pro- 
the video editor 320, may wish to edit low resolution media vided to the journalist at the journalist workstation 110 is 
data. The low resolution media data may either be a low shown in FIG. 4. The user interface 500 includes a number 
resolution composition created by a user of a journalist of windows including a viewing window 510, a clipnotes 
workstation or a low resolution version of media data window 520, a storyboard window 530, a storynotes win- 
captured by the media recorder 330. In either case, the video 25 dow 540 and a script window 550. 

production system user may search the multimedia archive The script window 550 provides an area in which the 
200 over the network 400 or may search the asset manager journalist can write the main script of a story being com- 
360 over the network 400 to retrieve the low resolution posed on the journalist workstation. Text can be generated in 
media data. After editing the low resolution media data, the this window using standard word processing commands, 
video editor 320 may transfer edited low resolution media 30 Graphics, including painting functions, can be performed on 
data to the multimedia archive 200 for cataloging and the journalist workstation and incorporated into the story- 
storage therein. board. 

Real-time Dual Resolution Digitization, Storage and Cata- The viewing window 510 displays a low resolution video 

log component of low resolution media data to be viewed and 

As described above, news video production from the 35 edited on the journalist workstation. The viewing window 

journalist workstation requires that an editable form of also displays the time code 516 of the video being displayed, 

media data be available to a user of the journalist worksta- machine controls 518, and editing functions such as mark in 

tion. The low resolution media data is stored in, cataloged by 512fl and mark out 5126 buttons. The machine controls 518 

and retrieved from the muUimedia archive 200. The low provide controls for playing a video clip in the viewing 

resolution media data is captured in the system using the 40 window and are similar to standard VTR controls. The 

media recorder 330. Hie media recorder 330 performs a dual machine controls can be selected by the user using a pointing 

resolution digitization of media data to be captured by the device, such as a mouse, or by using special function keys 

system. on a keyboard of the journalist workstation. Selecting a clip 

When media data is captured, the media recorder 330, in for display in the viewing window may be done by dragging 

conjunction with the MPEG encoder 340, performs a dual 45 a clip from the storyboard window 530 (described below) or 

resolution digitization of the media data to simultaneously by selecting a new clip from the multimedia archive, 

produce a high resolution version of the media data and a A second viewing window can be opened on the screen at 

low resolution version of the media data. As discussed the same time as the viewing window 510. The second 

above, the high resolution version of the media data is viewing window, in a preferred embodiment, is made visible 

digitized and compressed in a preferred embodiment using 50 by either shrinking or eUminating the storynotes window 

an MJPEG encoding format. The low resolution video is 540. 

compressed in a preferred embodiment using known, high llie mark in button 512^ and the mark out button 5126 are 

compression encoding techniques such as MPEG or Quick super-imposed in the upper left and upper right corners of 

Time, available from Apple Computer, Inc, Cupertino, Calif. the viewing window. These buttons are used to perform 

Although it is preferred to use either MPEG or Quick Time, 55 editing functions at the journalist workstation. When a video 

another compression technique which results in a high clip is being played in the viewing window 510, audio data 

compression ratio of the media data may also be used. By associated with the video data is played on speakers of the 

performing simultaneous capture of both the high resolution journalist workstation, A "video only" or "audio only*' 

version and the low resolution version of the media data, indication will appear on the video window when the media 

both forms of media data are immediately available in the 60 data being displayed or played on the workstation consists of 

system so that story editing can be performed to meet the audio only or video only. 

stringent deadlines encountered in broadcast news opera- The clipnotes window 520 provides a notepad for entry of 

tions even with late breaking material. short notes for each clip viewed on the viewing window 510. 

Journahst Workstation Low Resolution \^deo Browsing and The storynotes window 540 provides an area for the entry of 

Editing 65 notes that apply to the whole story to be edited as opposed 

One of the primary features of the system shown in FIG. to the cUpnotes window 510 which is for notes on individual 

3 is the ability to provide a user of the journalist worksta- clips. 
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The storyboard window 530 allows clips and subclips to 
be laid out in sequence. Each of, the clips 532 shown in the 
storyboard window 530 typically show the first frame of a 
corresponding clip, however, the user may select a frame 
other than the first frame to be shown in the storyboard 
window. The collection of clips stored in the storyboard 
window are referred to as a bin. The journalist has the option 
of playing one of the clips in the viewing window or playing 
the bin of clips as arranged in the storyboard window. 

The final pre-edited composition contained on the jour- 
nalist workstation may be transferred to the multimedia 
archive 200 for reuse by the journalist or other joxirnalists on 
other journalist workstations and for final editing and play- 
out by a user of the video production system. 



10 



The meta data information describes the media stored in 
the container. In one embodiment, the meta data contains the 
following information for each media object in the con- 
tainer: the name of the person that approved the data; the 
name of the person that created the data; a creation time 
stamp; a media identifier; media status; media type; names 
of all people that have modified the data; a modification time 
stamp; a reference number; research descriptors; timing 
information; title; and other user defined elements. 

The media and media pointers 65 are the actual raw data 
stored in the container. Media objects of many types may be 
stored in a single container. The media pointers point to a 
media object stored in another container. By storing a media 
pointer to another container, rather than the media of the 
other container itself, maximum storage efiSciency can be 



High Resolution Playout and Editing of Low Resolution 15 attained throughout the system. 

Compositions Pile structures, other than the container file structure 

A composition produced during a low resolution activity described above, may be used for storing the media data in 

on a journalist workstation may be played out in different the digital multi-media newsroom production system. For 

ways. A user of a journalist workstation may play the low example, the Open Media Framework (OMF''^") file 

resolution composition by retrieving the composition data 20 structure, described in Avid Technology, Inc. publication 



30 



from the multimedia archive, or a user of the video produc- 
tion system, for example a user of the video editor 320, may 
play and edit a high resolution version of the composition. 
The translation of the low resolution composition to its high 
resolution equivalent is transparent to the user of the video 25 
editor. The asset manager 360 using registration information 
of each of the low resolution sources used in the composition 
can identify the equivalent high resolution sources and 
translate the low resolution composition into its high reso- 
lution equivalent. Efficient translation by the asset manager 
requires a unique registration system for each of the clips 
stored within the system. Further, the registration method 
must include means for identifying the corresponding high 
resolution version of low resolution media data. A preferred 
registration method is described in detail further below. 

An editor, using the video editor 330, receives the high 
resolution version of the low resolution composition created 
by the journalist, and can fiirther edit the composition in 
broadcast quality format, to provide more precise editing 
cuts than accomplished by the journalist. 

In order to provide efficient transmission and storage of 
media data in the system shown in FIG. 3, a standard file 
structure is used for the media data contained within the 
system. In one embodiment of the present invention, the 



OMF™ Interchange Specification, which is incorporated 
herein by reference, may be used as the file structure for 
media files in the system. The structure described in Pub- 
lished per Application WO 93/21636, A Method and Appa- 
ratus For Representing and Editing Multimedia 
Compositions, incorporated herein be reference, may also be 
used in embodiments of the present invention. 

Another feature of the system shown in FIG. 3 is the 
ability to uniquely identify the media objects stored within 
the system and to locate other versions of media data that 
correspond to the media objects. The ability of the system to 
locate a high resolution version of media data, correspond- 
ing to a low resolution version of the same media data, 
allows the asset manager to provide a high resolution 
translation of combinations or storyboards generated by the 
3^ journalist workstation, such that the translation is transpar- 
ent to an editor using the video editor 320. 

The asset manager can uniquely identify the low resolu- 
tion and high resolution media data in a number of ways. In 
one embodiment of the present invention, the media data, 
40 when captured by the media recorder 330, is assigned a 
unique time code stamp corresponding to the date and time 
that the media data is captured by the media recorder. Using 
this scheme, the low resolution version of the media data and 



the high resolution version of the media data is assigned the 

media data is organized in a media container 600 as shown 45 same identification number. However, since the low resolu- 

in FIG. 5. The media container 600 is divided into five tion media data is stored in the multimedia archive, and the 

subsections including container data 610, container timing high resolution media data is stored in the media server, 

620, media security 630, meta data 640 and media or media there is no opportunity for confusion between the versions of 

pointers 650. the media data. The asset manager, in translating a combi- 

The information contained within the container data 610 so nation or storyboard from a low resolution version to a high 



describes the container itself and may include the following 
information: the name of the person that created the con- 
tainer data; the name of the person that approved the 
container data; an identification of the container security; a 
creation time stamp; the name of all people that have 
modified the data; a modification time stamp; a user's log; 
cost information associated with the data; and other user 
defined elements. 

Container timing 620 includes information related to a 



resolution version, can locate the high resolution version of 
each media object of the combination in the media server 
based on the identification number of the corresponding low 
resolution version of the media object. The above-described 
55 media data identifying method is not preferred for use at 
broadcast locations that do not maintain a unique timecode 
stamp. 

In a preferred embodiment of the present invention, the 
asset manager includes Media File Manager (MFM) and 



relationship over time of the media in the container. This 60 Source Manager (SM) software as described in U.S. Pat, No. 

information is only applicable to a story being prepared for 5,267351 to Reber et al which is incorporated herein by 

broadcast. reference. This software provides a unique identifier to 

The media security segment 630 provides further infor- media data captured by the system and maintains a table of 

mation concerning the security level of the media contained relationships between media objects contained within the 

within the container. This information can be used to restrict 65 system such that the asset manager can identify a corre- 

access to specified personnel of media contained within the sponding version of low resolution or high resolution media 

container. data. 
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In an alternate enabodiment of the present invention, a a communication network coupled to the media recorder 

digital multimedia newsroom production system consists and to the multimedia storage device to transfer the first 

only of the core newsroom system 100 and the multimedia and second versions of the media data to the multime- 

archive system 200 coupled by the digital network 400. In dia storage device; 

this alternate embodiment, a low resolution capture device is 5 an asset manager for registering each version of the 

coupled to the network 400 to capture low resolution media multimedia data using an identifier and for relating the 

data for storage in the news servers 120 and the multimedia identifiers of the first and second versions of the 

archive system 200. In this embodiment, the journalist multimedia data; 

workstations provide the full storyboard functions described a first editing system connected to the multimedia storage 

above with respect to the system 90 shown in FIG. 3. lo ^^^ice for creating a multimedia program using the first 

Embodiments of the present invention overcome Umita- ^QTsion of the multimedia data, wherein the first ver- 

tions of prior art systems by providing a fully integrated ^^^^ multimedia data used in the multimedia 

digital multimedia newsroom. In embodiments of the P^°g^^ f sp^ci^^d using the identifier for the fii^t 

present invention, a journalist in a news room may create a of multimedia data; and 

multimedia storyboard of a news story which is electron!- 15 ^ ^'^"^ ^'^'"'^ P'^'" connected to the multimedia 

cally transferred over a digital network to an editing and storage device for creating the multinaedia program 

< ^ r c 1 J u J * * • using the second version or the multimedia data, 

production system for final editing and broadcast to air. • i j- c • • *i. j- 

. jt - . c .t. • ' L L mcluding means for receiving the multimedia program 

Embodiments of the present invention have been ^^^^ (he first editing system and for identifying, 

described with respect to a multimedia prt^uction system in ^ ^^^^^ 

a newsroom enviromnent, however, embodiments of the 20 ^^^^ corresponding to the identifier specifying 

present invention are not limited to a newsroom ^^^^^ multimedia data used in the muW- 

environment, but rather may be used m other multimedia „ 

„ . t • t . . media program, 

environments as weU, such as radio, and m the production of 2. The multimedia production system of claim 1, wherein 

entertamment programming. the means for generating the second version of the multi- 

In embodiments of the present mvention described above, 25 ^^^ia data includes means for compressing the second 

the multunedia data processed on the joumahst workstation ^^^^^ „f multimedia data. 

has been descnbed as low r<»olulion multimedia data. The 3 multimedia production system of claim 2, wherein 

user interface provided by the journalist worl^taticn may second version of the multimedia data includes broadcast 

also be used to create storyboards using high resolution .^i^^j^j^^ ^^^^^y resolution multimedia data. 

mu ime la a a. - l j. 4. The multimedia production system of claim 1, wherein 

Havmg thus described at least one illustratwe embodi- the second version of the multimedia data includes broadcast 

ment of the mvention, vanous alterations, modifications and ^^^^^^^^ q^^Hty resolution multimedia data, 

unprovements wiU readily occur to those skiUed m the art. 5 multimedia production system of claim 1, wherein 

Such alterations modifications and improvements are ^ .^^^^^^ ^^^^ ^^^^ 

intended to be withm the scope and spirit of the mvention. 35 corresponding to the multimedia program. 

Accordingly, the foregomg description by way o example g niultimedia production system of claim 1, wherein 

only. It IS not mtended as limiting. Hie mvention s Imiit is ^-^^^ resolution is a lower resolution than the 

defined only m the claims and the equivalents thereto. ^.^^^ resolution. 

What is claimed is: . u • ^ 7. The multimedia production system of claim 1, wherein 

1. A multimedia production system for browsing and 40 ^eans for generating the first version of the multimedia data 

ediUng mulumedia data comprismg: -^^j^^^^ ^^^^^ compressing the multimedia data and 

a media recorder that digitizes the multimedia data, the wherein the first video resolution substantially different than 

media recorder including: the second video resolution by an extent of compression of 

means for generating a first version of the muhimedia the first version of the multimedia data. 

data having a first video resolution; and 45 g multimedia production system of claim 1 , wherein 
means for generating a second version of the multime- the second editing system fiirlher comprises means for 
dia data having a second video resolution; and playing the multimedia program including means for sub- 
wherein the first video resolution is substantially dif- stituting the identifier specifying the first version of mulli- 
ferent than the second video resolution; media data with an identifier specifying the second version 
a multimedia storage device that stores the first version of of multimedia data, 
the multimedia data and the second version of the 

multimedia data; ♦ * ♦ ♦ * 
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